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MEDICAL DIAGNOSTIC ULTRASONIC IMAGING METHOD AND 
SYSTEM FOR DISPLAYING MULTI-PHASE, MULTI-FRAME IMAGES 

BACKGROUND 

This invention relates generally to medical diagnostic ultrasonic 
imaging techniques, and in particular to such imaging techniques that provide 
multiple images displayed in sequence, wherein each image is associated 
with a respective phase of a physiological cycle. 

U.S. Patent Application Serial No. 08/916,585, filed August 22, 1997, 
discloses a system for collecting single frames of image data from each of a 
plurality of spatial locations. Tracking information is collected with each 
frame, and this tracking information is used to assemble the frames into a 
static three-dimensional image or an extended field of view image. In three- 
dimensional imaging, the transducer probe is swept across a three- 
dimensional volume, and the tracking data is obtained along tracking planes 
oriented generally transverse to the image planes. In extended field of view 
imaging, the transducer probe is maintained within a plane such that multiple 
image frames are obtained in the same plane. The tracking information is 
then used to reconstruct an extended (typically elongated) field of view from 
multiple ones of the coplanar images. In both cases, the three-dimensional 
image or the extended field of view image is a static image. The entirety of 
the above-identified U.S. Patent Application Serial No. 08/916,585 is hereby 
incorporated by its reference for its teaching of techniques for forming three- 
dimensional images and extended field of view images. 

It is also known to acquire image frames from a particular part of the 
cardiac cycle. This can be done by triggering image acquisition at a specified 
time duration after a particular feature of the ECG signal, such as the R wave. 

BRIEF SUMMARY 

The present invention is defined by the following claims, and nothing in 
this section should be taken as a limitation on these claims. 
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By way of introduction, the preferred embodiments described below 
acquire image data for multiple frames at a plurality of transducer positions. 
Each frame is identified with a respective phase of a physiological cycle such 
as the heart cycle, and a multi-frame image data set is then formed from the 
5 acquired frames. This data set may be a multiphase three-dimensional data 

set or alternatively a multiphase extended field of view data set. Then 
multiple images are generated from the three-dimensional data set or the 
extended field of view data set, each image associated with a respective 
phase of the physiological cycle. These images are then displayed in 
1 0 sequence to a user. In this way the user obtains the advantage of multi-frame 

imaging (three-dimensional imaging or extended field of view imaging), along 
with the advantage of a display that sequentially shows the selected view for a 
sequence of phases of the physiological cycle. 

BRIEF DESCRIPTION OF THE DRAWINGS 
1 5 FIG. 1 is a flow chart of a method that incorporates a first preferred 

embodiment of this invention. 

FIG. 2 is a schematic diagram illustrating a multiphase 3-D data set 
created using the method of FIG. 1 . 

FIGS. 3 and 4 are schematic diagrams of alternative embodiments for 
20 practicing the method of Figure 1 . 

FIG. 5 is a flow chart of a method that incorporates a second preferred 
embodiment of this invention. 

FIG. 6 is a schematic diagram of a multiphase extended field of view 
data set created using the method of Figure 5. 

25 DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED 

EMBODIMENTS 

Turning now to the drawings, the method illustrated in FIG. 1 initially 

acquires image data for N frames at each of a plurality of transducer 

positions, wherein each frame is identified with a respective phase of a 

30 physiological cycle and N is greater than or equal to 2 (block 10). In one 

example, the image frames acquired in block 10 are each identified with a 
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respective phase of an ECG signal. Typically, 10 to 25 frames of image data 
are acquired at each transducer position for each cardiac cycle. This 
represents a balance between computational requirements and adequate 
display of a moving image. For simplicity, the following example will consider 
5 the case where N equals 10, and 10 image data frames are collected for each 

transducer position. If the average ECG period is 1000 ms, this represents an 
interval of about 100 ms between consecutive frames of acquired image data. 
In general, it is preferable to acquire a large number of frames per heart cycle, 
but this will often lead to a large amount of data requiring a great deal of 

10 memory. The image data preferably comprises one or more of B-mode, color 

Doppler velocity, and color Doppler energy information. 

In block 12 of the method of Figure 1, the image data is used to 
construct a multiphase 3-D data set. That is, respective image data frames 
are associated with corresponding positions and phases with respect to a 

15 physiological cycle (e.g., the heart cycle as indicated by an ECG signal) in the 

3-D data set. 

FIG. 2 shows a schematic representation of the multiphase 3-D data 
set in which a plurality of frames 20 have been positioned within a three- 
dimensional volume 22. Each frame includes a plurality of data points, and 

20 the point P1 is indicated. P1 includes the data for point 1 for each of the N 

phases <j>1 through ^N, as schematically shown in FIG. 2. 

In block 14 of Figure 1, a series of L views is selected. L is an integer 
greater than zero, and the term "series" is intended broadly to cover one or 
more views. Typically, each view may be an arbitrarily positioned plane within 

25 a three-dimensional space. For example, each view may be slightly displaced 

from the previous view when L>1 . Alternately, the selected view or views can 
be those appropriate for a surface rendering, a volume projection such as a 
maximum intensity projection, or multiple orthogonal slices. 

In block 16, M images are generated from the 3-D data set for each of 

30 the selected views, each image associated with a respective phase with 

respect to a physiological signal. The same viewing calculation (e.g. 
extracting a two-dimensional view from the three-dimensional data set) is 
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performed on the separate phases for each phase of the physiological cycle 
stored in the data set (10 in this example). This is repeated for all of the 
views. 

In block 18, the M images for a given view are displayed in sequence 
5 to a user. This can be done by playing the M images sequentially on a video 

display at a frame rate equivalent to the acquisition rate. For example, if the 
phases are acquired at 100 ms intervals, then the output can be displayed at 
1 00 ms intervals between consecutive frames. Preferably, the user is 
provided with means (not shown) for directing the system to play the images 
1 0 back at a faster or slower rate if desired, or to pick out static frames from the 

sequence. Alternately, the user of the system can change the view while 
cycling through the M cardiac phases. The user will perceive a pulsating 
object while the view is changing. 

FIG. 3 shows a block diagram of a medical diagnostic imaging system 
15 suitable for implementing the method of FIG. 1 . The system illustrated in 

FIG. 3 is closely related to that disclosed in the above-identified U.S. Patent 
Application Serial No. 08/916,585, and that application should be consulted 
for further details of operation. 

Briefly, the system 30 includes a transducer probe 32 having an image 
20 transducer array 34 and first and second tracking transducer arrays 36, 38. 

Preferably, the tracking transducer arrays 36, 38 are oriented at right angles 
to the image transducer array 34. 

The transducer probe 32 is connected to a transmit/receive 
beamformer 40 which is in turn coupled to a scan converter 42 and an output 
25 display 44. An ECG module 46 provides a signal indicative of the ECG cycle 

to a system controller 48. 

The system controller 48 controls the beamformer 40 and the scan 
converter 42 to generate image data that is stored in a memory 50 and 
tracking data that is stored in memories 52 and 54. 
30 In this example 10 frames of image data are stored in the memory 50 

for each spatial position of the transducer probe, and each frame is time 
stamped with the respective phase with respect to the heart cycle. Tracking 
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data is stored in memories 52 and 54 only for the first frame of each set of 
frames associated with a single position. Typically, the first frame in each set 
(t = 0 in FIG. 3) is phased to a stable portion of the heart cycle, such as 
30 milliseconds after the R wave. Of course, instead of the first frame after 
5 the R wave, position information may be stored for any desired phase of the 

heart cycle. 

A motion estimator 56 estimates frame-to-frame motion, using the 
techniques described at length in U.S. Patent Application Serial 
No. 08/916,585. In this case, one motion estimate determined from the 

1 0 selected phase is used for all phases of the cardiac cycle associated with the 

respective position. For example, all frames for position 1 are associated with 
the same estimate of motion that is determined for position 1 using the 
tracking data for t = 0. This is believed to be a good approximation that saves 
a considerable amount of computational time. In some applications speckle 

15 may become decorrelated, and this may affect motion estimation accuracy. 

Therefore, in an alternate preferred embodiment, all frames are used to 
estimate motion. Motion estimates obtained by the motion estimator 56 are 
provided to a motion vector smoother 58, and the smoothed motion vectors 
are used to determine frame-to-frame vector motion in block 60. Computer 62 

20 uses these frame-to-frame motion vectors to register the image data from the 

memory 50, as shown by way of example in FIG. 2. That is, the position 
information obtained from the block 60 is used to register the image data from 
the memory 50 by means of standard three-dimensional image interpolation. 
In this way the desired multiphase three-dimensional data set is constructed 

25 from the image data and is stored in the memory 64. 

The user selects one or more views, and the computer 62 performs the 
necessary display processing to generate a plurality of images from the 3-D 
data set for each selected view, each image associated with the respective 
phase of the physiological cycle. These images are then displayed in 

30 sequence to a user on a display 66. 

FIG. 4 shows an alternative, preferred embodiment that is similar to the 
embodiment of FIG. 3, except that the embodiment of FIG. 4 stores tracking 
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data for frames of each phase. In this way tracking data is stored for all 
frames, not a subset of frames. The 3-D volume filling computer 62 creates a 
separate three-dimensional data set for each separate respective phase from 
the two-dimensional image frames associated with that phase, and the N 
5 separate 3-D data sets, taken together, can be considered a multi-phase 3-D 

data set. In other respects the embodiment of FIG. 4 operates similarly to that 
described above in conjunction with FIG. 3. 

The foregoing discussion is related to three-dimensional data set 
embodiments of this invention. Other implementations of the invention relate 

10 to extended field of view imaging. As shown in FIG. 5, one preferred method 

acquires image data for N frames at each of a plurality of transducer 
positions, each frame identified with a respective phase of a physiological 
cycle. In this case the separate frames are coplanar. Next, M extended field 
of view images are generated from the image data, each image associated 

15 with a respective phase. Finally, the M images are presented in sequence to 

a user. 

FIG. 6 is a schematic diagram showing the manner in which three 
frames 70, 72, 74 are combined to produce an extended field of view. The 
cross-hatched fractions of the frame 72 and the frame 74 are combined with 

20 the cross-hatched portion of the frame 70 to produce an extended field of view 

that is elongated as compared to any one of the image frames. As shown in 
FIG. 6, the extended field of view data set is a multiphase data set in the 
sense that for each point, such as the point P2, image data is provided for 
each of N separate phases <j>1 , §2, (j>3, . . . c|>N. 

25 This alternative embodiment can be implemented in a manner similar 

to that described above in conjunction with FIGS. 3 and 4. In this case, the 
tracking data (which may be obtained from the image data) is preferably 
obtained in the same plane as the image data. The computer 62 forms the 
extended field of view data set including image information for each of the 

30 selected phases of the physiological cycle. The computer 62 then generates 

a sequence of extended field of view images from the image data, each 
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extended field of view image associated with the respective phase of the 
physiological cycle. 

Of course, many alternatives are possible to the preferred 
embodiments described above. For example, in some ultrasound systems an 
5 ECG signal is not available. One alternative for extracting a cardiac time 

reference is to detect the frame in which maximum Doppler flow velocity or 
energy is detected, for example by summing all energy levels for all color 
pixels and then dividing by the number of color pixels to derive mean energy. 
In this approach it is preferable to use a fast acquisition rate for detecting the 
10 maximum Doppler flow rate (such as 20 frames per second or higher). 

Regardless of the frame rate that is used for the purpose of detecting the 
Doppler flow maximum, only a subset of frames is preferably used for 
generating the multiphase 3-D data set or the multiphase extended field of 
view data set. 

15 In the foregoing discussion, for both 3-D multiphasic imaging and for 2- 

D extended field of view multiphasic imaging, N frames are acquired for each 
of the plurality of transducer positions, each frame corresponding to a body 
cycle phase. In the more general case, the transducer can be continually 
moved while N frames are acquired. Furthermore, the number of frames 

20 acquired for successive body cycles may be different. Since the time stamp 

for the beginning of the body cycle (R-wave, for example) and the time 
stamps for each acquired images are known using the previously described 
means, M images, each associated with a respective phase of the body cycle, 
can still be generated. 

25 Furthermore, this invention is not limited to use with cardiac cycles. 

Rather, it is well suited for use with a wide variety of physiological cycles, 
including the respiratory cycle. 

As used herein, the term "multi-frame" as applied to a data set or an 
image means that data from two or more separate frames contribute to the 

30 data set or image. Though possible, it is not required that two or more entire 

frames contribute to the data set or image. 
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It should be apparent from the foregoing that a dynamic, multi-frame 
image display has been described which exhibits the advantages of three- 
dimensional imaging or extended field of view imaging in combination with the 
ability to acquire and present data from a sequence of phases of the selected 
5 physiological cycle. 

The foregoing detailed description has described only a few of the 
many forms that this invention can take. For this reason this detailed 
description is intended by way of illustration and not by way of limitation. It is 
only the following claims, including all equivalents, that are intended to define 
1 o the scope of this invention. 



CLAIMS 



1 . A medical diagnostic ultrasound imaging method comprising: 

(a) acquiring image data for at least two frames, each frame 
identified with a respective phase of a physiological cycle; 

(b) constructing a multi-phase, multi-frame data set from the 
image data by registering the image data based on image motion between the 
frames, 

(c) generating a plurality of images from the multi-frame data 
set, each image associated with a respective phase of the physiological cycle; 
and 

(d) displaying the images in sequence to a user. 

2. The method of Claim 1 wherein (b) comprises: 

(b1 ) associating a separate position with each frame of image 

data; and 

(b2) creating a plurality of separate multi-frame data sets 
included in the multi-phase, muilt-frame data set, each separate multi-frame 
data set identified with a respective phase of the physiological cycle. 

3. The method of Claim 1 wherein (b) comprises: 

(b1 ) associating a separate position with each frame of image 
data associated with one selected phase of the physiological cycle; and 

(b2) using the positions associated with the one selected 
phase of the physiological cycle to create the multi-frame, multi-phase data 
set for all of the image data. 

4. The method of Claim 1 wherein the multi-phase, multi-frame 
data set constructed in (b) comprises a 3-D data set. 

5. The method of Claim 1 wherein the multi-phase, multi-frame 
data set constructed in (b) comprises a extended field of view data set. 

6. A medical diagnostic ultrasound imaging means comprising: 
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means for acquiring image data for at least two frames, each 
frame identified with a respective phase of a physiological cycle; 

means for constructing a multi-phase, multi-frame data set from 
the image data, said constructing means comprising means for registering the 
image data based on image motion between frames; 

means for generating a plurality of images from the multi-frame 
data set, each image associated with a respective phase of the physiological 
cycle; and 

means for displaying the images in sequence to a user. 

7. The invention of Claim 6 wherein the constructing means 
comprises: 

means for associating a separate position with each frame of 
image data; and 

means for creating a plurality of separate multi-frame data sets 
included in the multi-phase, multi-frame data set, each separate multi-frame 
data set identified with a respective phase of the physiological cycle. 

8. The invention of Claim 6 wherein the constructing means 
comprises: 

means for associating a separate position with each frame of 
image data associated with one selected phase of the physiological cycle; and 

means for using the positions associated with the one selected 
phase of the physiological cycle to create the multi-phase, multi-frame data 
set for all of the image data. 

9. The invention of Claim 6 wherein the multi-phase, multi-frame 
data set comprises a 3-D data set. 

1 0. The invention of Claim 6 wherein the multi-phase, multi-frame 
data set comprises a extended field of view data set. 

11. A medical diagnostic ultrasound imaging method comprising: 
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(a) acquiring image data for at least two frames, each frame 
identified with a respective phase of a physiological cycle; 

(b) generating a plurality of extended field of view images 
from the image data, each image associated with a respective phase of the 
physiological cycle; and 

(c) displaying the images in sequence to a user. 

12. The method of Claim 1 1 wherein (b) comprises: 

(b1 ) associating a separate position with each frame of image 

data; and 

(b2) creating a plurality of separate extended field of view data 
sets, each data set identified with a respective phase of the physiological 
cycle. 

13. The method of Claim 1 1 wherein (b) comprises: 

(b1 ) associating a separate position with each frame of image 
data associated with one selected phase of the physiological cycle; and 

(b2) using the positions associated with the one selected 
phase of the physiological cycle to create the multi-phase extended field of 
view data set for all of the image data. 

14. A medical diagnostic ultrasound imaging system comprising: 

(a) means for acquiring image data for at least two frames, 
each frame identified with a respective phase of a physiological cycle; 

(b) means for generating a plurality of extended field of view 
images from the image data, each image associated with a respective phase 
of the physiological cycle; and 

(c) means for displaying the images in sequence to a user. 

15. The invention of Claim 14 wherein the generating means 
comprises: 

means for associating a separate position with each frame of 
image data; and 



means for creating a plurality of separate extended field of view 
data sets, each data set identified with a respective phase of the physiological 
cycle. 

16. The invention of Claim 14 wherein the generating means 
comprises: 

means for associating a separate position with each frame of 
image data associated with one selected phase of the physiological cycle; and 

means for using the positions associated with the one selected 
phase of the physiological cycle to create a multi-phase extended field of view 
data set for all of the image data. 
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ABSTRACT OF THE DISCLOSURE 

A medical diagnostic ultrasonic imaging system acquires image data 
for at least two frames at each of multiple positions, each frame identified with 
a respective phase of a physiological cycle. A multiphase 3-D or extended 
5 field of view data set is constructed from the image data. Then a plurality of 

images are generated from the multiphase data set. Each image is 
associated with a respective phase of the physiological cycle, and these 
images are displayed in sequence to a user. 
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The document was recorded in the Patent and Trademark Office at 
Reel , frame , or a copy thereof is attached. 

2. From To: 

The document was recorded in the Patent and Trademark Office at 

Reel , frame , or a copy thereof is attached. 

□ Additional documents in the chain of title are listed on a supplemental sheet. 
The undersigned has reviewed the assignment or all the documents in the chain of title of the patent application identified 
above and, to the best of undersigned's knowledge and belief, title is in the assignee identified above. 

The undersigned (whose title is supplied below) is empowered to act on behalf of the assignee. 

I hereby declare that all statements made herein of my own knowledge are true, and that all statements made on information 
and belief are believed to be true; and further, that these statements are made with the knowledge that willful false statements, and the 
like so made, are punishable by fine or imprisonment, or both, under Section 1001, Title 18 of the United States Code, and that such 
willful false statements may jeopardize the validity of the application or any patent issuing thereon. 



Signature rLJ^ Date: 8/3/^1 

Name: Charles H. Dearborn 

Title: Vice President, General Counsel and Secretary 



